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Abstract 

The subject is the overview of the use of quasi-entropy in finite dimensional 
spaces. Matrix monotone functions and relative modular operators are used. The 
origin is the relative entropy and the /-divergence, monotone metrics, covariance 
and the x 2 divergence are the most important particular cases. The extension of 
the monotone metric to two variables is a new concept. 
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Quasi-entropy was introduced by Petz in 1985 as the quantum generalization of 
Csiszar's /-divergence in the setting of matrices or von Neumann algebras. The im- 
portant special case was the relative entropy of Umegaki and Araki. In this paper the 
applications are overviewed in the finite dimensional setting. Quasi-entropy has some 
similarity to the monotone metrics, in both cases the modular operator is included, but 
there is an essential difference: In the quasi-entropy two density matrices are included 
and for the monotone metric on foot-point density matrices. In this paper two density 
matrices are introduced in the monotone metric style. 



1 Quasi-entropy 



Let Ad denote the algebra ofnxn matrices with complex entries. For positive definite 
matrices pi, p<i G Ad, for A G Ad and a function / : R + — > IR, the quasi-entropy is defined 
as 

1/2 p ( \ ( I \\( A 1 / 2 \ 



Sf( Pl \\p 2 ) := <AprJ(A(pi/p 2 ))(A P n> 

i /2 ), 



Trpf (A*/(A(pi/p 2 ))Apf ' 
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where (B,C) := TtB*C is the so-called HUbert- Schmidt inner product and A(pi/p 2 ) : 
J\A — > Ai is a linear mapping acting on matrices: 

A( Pl /p 2 )B = P iBp 2 l . 

This concept was introduced by Petz in 1985, see [T9l [20] . or Chapter 7 in [18]. (The 
relative modular operator A(pi/ p 2 ) was born in the context of von Neumann algebras 
and the paper of Araki [JJ had a big influence even in the matrix case.) The quasi- 
entropy is the quantum generalization of the /-divergence of Csiszar used in classical 
information theory (and statistics) [2J [16] • Therefore the quantum /-divergence could 
be another terminology as in [TO] . 

The definition of quasi-entropy can be formulated with mean. For a function / the 
corresponding mean is defined as rrih(x,y) = f{x/y)y for positive numbers, or for com- 
muting positive definite matrices. The linear mappings 

L Pl X = p\X and R P2 X = Xp 2 

are positive and commuting. The mean rrif makes sense and 

S/(pi||p 2 ) = (A,m f (h pi ,R P2 )A). (2) 

Let a : A^o — > -M be a mapping between two matrix algebras. The dual a* : M. — > 
Aio with respect to the Hilbert-Schmidt inner product is positive if and only if a is 
positive. Moreover, a is unital if and only if a* is trace preserving, a : Mq — > M. is 
called a Schwarz mapping if 

a(B*B) > a(B*)a(B) (3) 

for every B e M.q. 

The quasi-entropies are monotone and jointly convex [TBI |2"0] . 

Theorem 1 Assume that f : IR + — > R is an operator monotone function with /(0) > 
and a : Ai — >■ M. is a unital Schwarz mapping. Then 

^( a *(p 1 )||a*(p 2 ))>^ (A) (PillP2) (4) 

holds for A G M.q and for invertible density matrices pi and p 2 from the matrix algebra 
M. 

Proof: The proof is based on inequalities for operator monotone and operator concave 
functions. First note that 

5'/ +c (a*(p 1 )||a*(p 2 )) = S'/(a*(p 1 )||a*(p 2 )) + cTrp ia (^)) 

and 

sf + t\pi\\P2) = sf A \ Pl \\p 2 ) + cTT P M(Aya{A)) 
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for a positive constant c. Due to the Schwarz inequality ([3]), we may assume that 
/(0) = 0. 

Let A := A(p 1 /p 2 ) and A := A(a*(p 1 )/a*(p 2 ))- The operator 

VXa*{p 2 ) 1/2 = a{X)p\' 2 {X e M ) (5) 

is a contraction: 

\\a(X)p 1 2 /2 \\ 2 = Trp 2 (a(X)*a(X)) 

< Tip 2 (a(X*X) = Tra*(p 2 )X*X = ||Xa*(p 2 ) 1/2 H 2 

since the Schwarz inequality is applicable to a. A similar simple computation gives that 

V*AV < A . (6) 

Since / is operator monotone, we have /(A ) > f(V*AV). Recall that / is operator 
concave, therefore f(V*AV) > V*f(A)V and we conclude 

/(Ao)>V7(A)V. (7) 

Application to the vector Aa*{p 2 ) 1 ^ 2 gives the statement. □ 

It is remarkable that for a multiplicative a we do not need the condition /(0) > 0. 
Moreover, V*AV = Ao and we do not need the matrix monotonicity of the function /. 
In this case the only condition is the matrix concavity, analogously to Theorem [TJ If we 
apply the monotonicity (jJJ) to the embedding a(X) = X © X of M. into M. © M. and 
to the densities p\ = \E\ © (1 — X)Fi, p 2 = \E 2 © (1 — X)F 2 , then we obtain the joint 
concavity of the quasi-entropy: 

Theorem 2 If f : R + — > R is an operator convex, then Sf(pi\\p 2 ) is jointly convex in 
the variables p\ and p 2 . 

If we consider the quasi-entropy in the terminology of means, then we can have another 
proof. The joint convexity of the mean is the inequality 

f(L(Ai+A 2 )/2R^ Bl+B2 y 2 )R(B 1 +B 2 )/2 < \f(L Al R~ B \)R Bl + \f(L A2 B~ B 1 2 )R B2 

which can be simplified as 

f(L A 

1 +a 2 Rb 1 +b 2 ) 

^ It B 1 +B 2 n B 1 Jy- L Ai n B 1 ) n B 1 n B^+B 2 + U B 1 +B 2 U B 2 J K L, A 2 ^B 2 ) n B 2 U B 1 +B 2 

< Cf{L M R- B l)C* + Df(L A2 R B l)D*. 
Here CC* + DD* = I and 

C(L Al R B \)C* + D(L A2 R B l 2 )D* = L Al+A2 R B \ +B2 . 
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So the joint convexity of the quasi-entropy has the form 

f(CXC* + DYD*) < Cf(X)C* + Df(Y)D* 

which is true for an operator convex function / [5j El] . 

If / is operator monotone function, then it is operator concave and we have joint 
concavity in the previous theorem. The book [23] contains information about operator 
monotone functions. The standard useful properties are integral representations. The 
Lowner theorem is 

f{x) = f{O)+0x+ / -— — d/i(A) . 

Jo A + x 

An operator monotone function / : R + — >• R + will be called standard if xf(x~ v ) = f(x) 
and /(l) = 1. A standard function / admits a canonical representation 

/(«) = l±* e*p/ (1 - «)» (A + ^^-^ + 1)2 MA) iK (8) 
where h : [0, 1] —> [0, 1] is a measurable function [6]. 

2 Applications 

The concept of quasi-entropy includes many important special cases. 
2.1 /-divergences 

If P2 and pi are different and A = I, then we have a kind of relative entropy. For 
f(x) = xlogx we have Umegaki's relative entropy S(pi\\p 2 ) = Trp 1 (logp 1 — logp 2 )- 
(If we want a matrix monotone function, then we can take f(x) = log a; and then we 
get S(p2\\pi)-) Umegaki's relative entropy is the most important example, therefore 
the function / will be chosen to be matrix convex. This makes the probabilistic and 
non- commutative situation compatible as one can see in the next argument. 

Let pi and p2 be density matrices in M.. If in certain basis they have diagonal 
P = (Pi-P2, • • • ,p n ) an d q = (qi, q2, ■ ■ ■ , q n ), then the monotonicity theorem gives the 
inequality 

Df{ P \\q)<S s { Pl \\p2) (9) 

for a matrix convex function /. If p\ and P2 commute, them we can take the common 
eigenbasis and in OH]) the equality appears. It is not trivial that otherwise the inequality 
is strict. 
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If pi and p 2 are different, then there is a choice for p and q such that they are different 
as well. Then 

< D f (p\\q) < SfMfr). 

Conversely, if Sf(pi\\p 2 ) = 0, then p = q for every basis and this implies p\ = p 2 . For 
the relative entropy, a deeper result is known. The Pinsker-Csiszdr inequality says that 

|b-g||?<2£>(p||g). (10) 

This extends to the quantum 

\\p 1 -p 2 \\l<2S(p 1 \\p 2 ), (11) 

see 0, or [21 Chap. 3]. 

Example 1 The /-divergence with f(x) = xlogx is the relative entropy. It is rather 
popular the modification of the logarithm as 



xP -I 

T 



\ogpx = — r - (/9e (0,1)) 



and the limit j3 — > is the log. If we take fp(x) = xlog^x, then 

Tr o 1+P o' P - 1 

s,(pM= Pl P * ■ 

Since fp is operator convex, this is a good generalized entropy. It appeared in the paper 
[2T] . see also [TBI Chap. 3], there 7 is written instead of (3 and 

S( Pl \\p 2 ) < Sp( Pl \\p 2 ) 09 e (o,i)) 

is proven. 

The relative entropies of degree a 

S a (p 2 \\pi) ■= T7~~ rTr (/ - pip 2 a )p 2 - 

a(l — a) 

are essentially the same. □ 
The /-divergence is contained in details in the recent papers [251 [TO] . 

2.2 WYD information 

In the paper [12] the functions 



9 P {x) 



^pj( x ~ xP ) if V ^ h 
x log x if p = 1 
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are used, this is a reparametrization of Example [U (Note that g p is well-defined for x > 
and p 7^ 0.) The considered case is p G [1/2, 2], then g p is operator concave. 

For strictly positive A and B, Jencova and Ruskai define 

J P (K,A,B) = Tr yfBK* g p {L A R^)(KVB) 
which is the particular case of the quasi-entropy Sf(A\\B) with / = g p . 

The joint concavity of J P (K, A, B) is stated in Theorem 2 in [12] and this is a particular 
case of Theorem [2] above. For K = K*, we have 

J P (K, A, A) = -^T^)Tr [K, A*\[K, A^\ 

which is the Wigner-Yanase-Dyson information (up to a constant) and extends it to the 
range (0, 2}. 



2.3 Monotone metrics 

Let M. n be the set of positive definite density matrices in M n . This is a manifold and 
the set of tangent vectors is {A = A* G M n : Tr A = 0}. A Riemannian geometry is 
a set of real inner products 7r>(A B) on the tangent vectors [17J. By monotone metrics 
we mean inner product for all matrix spaces such that 

^ {D) (/3(A),P(A))< lD (A,A) (12) 

for every completely positive trace preserving mapping : M n — > M m . 

Define : M„ M n as 

I f D = f{h D R D 1 )R D = h D m f R D , (13) 

where / : R + — > 1R + and m/ is the mean induced by the function /. 

It was obtained in the paper [22] that monotone metrics with the property 

7d(A,A) = TiD^A 2 if AD = DA (14) 

has the form 

lD (A,B) = TiA^ f D )-\B) (15) 

where / is a standard matrix monotone function. These monotone metrics are abstract 
Fisher informations, the condition (1141) tells that in the commutative case the classical 
Fisher information is required. The popular case in physics corresponds to f(x) = 
(1 + x)/2, this gives the SSA Fisher information. 

Since 

TiA(I f D )-\B) = {{AD- l )D l '\-(/\{D/D)){AD- l )D 1 ^), 
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7D {A,A) = Sffr l (D\\D). 



we have 

I A A\ C 

1// 

So the monotone metric is a particular case of the quasi-entropy, but there is another 
relation. The next example has been well-known. 



Example 2 The Boguliubov-Kubo-Mori Fisher information is induced by the function 



x — 1 



f(x) = - = / x % dt. 

log a; 



o 

Then 

-1 pi 



and computing the inverse we have 



D A= / {h D R D l YR D Adt= / D t AD x - t dt 
Jo Jo 



POO 

1% KM (A,A)= / Tr (D + tI)- 1 A(D + tI)~ 1 A dt. 
Jo 

A characterization is in the paper |3] and the relation with the relative entropy is 

1 B D KM {AB) = ^-S{D + tA\\D + sB). 



□ 



Ruskai and Lesniewski discovered that all monotone Fisher informations are obtained 
from an /-divergence by derivation [T3] : 

1 f D (A,B) = ^-S F (D + tA\\D + sB) 

The relation of the function F to the function / in this formula is 

J_ Ftf+tFjt- 1 ) 

fit) (t-iy ■ { 1 

If D runs on all positive definite matrices, conditions 7d(A, A) G M for self-adjoint 
A and (Tl4|) are not required, but the monotonicity (JT2l) is assumed, then we have the 
generalized monotone metric characterized by Kumagai [13]. They have the form 

K p (A,B) = b(Trp)TrA*TvB + c(A, (Jj)" 1 ^)), 

where / : M + — > IR + is matrix monotone, /(l) = 1,6: M + — >■ M + and c > 0. 
Let : M n ® M 2 ->■ M m be defined as 



-S21 -B22 



I ^ -Bll + -E?22- 
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This is completely positive and trace-preserving, it is a so-called partial trace. For 

XB 
{l-X)B 

the inequality ( 1T2"j) gives 

7ad 1+( i-a)d 2 (5, B) < j XDl {XB, XB) + 7 (i-W(l - X)B, (1 - X)B). 

Since •y tD (tA,tB) = tj D (A,B), we obtained the convexity. 

Theorem 3 For a standard matrix monotone function f and for a self-adjoint matrix 
A the monotone metric T D (A, A) is a convex function of D. 

This convexity relation can be reformulated from formula (Tl5|) . We have the convexity 
of the operator in the positive definite D. 



D 



XDi 
(1-A)£> 2 



.4 



2.4 Generalized covariance 

If pi = Pi = p and A,B e M are arbitrary, then one can approach to the generalized 
covariance |23j. 

qCov^fl) := (V /2 ,/(A(p/p))(V /2 )> - (TrpA*)(TrpB). (17) 

is a generalized covariance. The first term is (A,SpB) and the covariance has some 
similarity to the monotone metrics. 

If p, A and B commute, then this becomes /(l)Tr pA*B — (Tr pA*)(Tr pB). This shows 
that the normalization /(l) = 1 is natural. The generalized covariance qCoVp(A, B) is 
a sesquilinear form and it is determined by qCov^(A, A) when {A £ Ai : Tr pA = 0}. 
Formally, this is a quasi-entropy and Theorem [1] applies if / is matrix monotone. If we 
require the symmetry condition qCov£(A, A) = qCov^(A*, A*), then / should have the 
symmetry xf{x~ l ) = f{x). 

Assume that Tr pA = Tr pB = and p = Diag (Ai, A2, . . . , A„). Then 

qCov f p (A, B) = J^ XJiXj/XjA*^. (18) 

u 

The usual symmetrized covariance corresponds to the function f(t) = (t + l)/2: 
Cov p (A,B) := ^Ti (p(A*B + BA*)) - (Tr pA*)(Tr pB). 

The interpretation of the covariances is not at all clear. In the next section they will 
be called quadratic cost functions. It turns out that there is a one-to-one correspondence 
between quadratic cost functions and Fisher informations. 
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Theorem 4 For a standard matrix monotone function f the covariance qCov^A, A) is 
a concave function of p for a self-adjoint A. 

Proof: The argument similar to the proof of Theorem [3j Instead of the inequality 
fi*{%(D))~ l fi - Ud) -1 we use tne inequality (3H f D (3* < J^ (D) (see Theorem 1.2 in [26] or 
[23]). This gives the concavity of (A, Jta). The convexity of (Tr pA) 2 is obvious. □ 



2.5 x 2 "divergence 

The x 2 -divergence 

(Pi - Qi) 2 \- ( P 



■ Qi ; \Qi 



was first introduced by Karl Pearson in 1900. Since 



we have 

\\p-q\\\<x 2 (p,q)- (19) 

We also remark that the x 2 -divergence is an /-divergence of Csiszar with f(x) — (x— l) 2 
which is a (matrix) convex function. In the quantum case definition ([T]) gives 

S f (p,a) = Trp 2 a- 1 -l. 

Another quantum generalization was introduced very recently in [25] : 

X 2 a (p, a) = Tr (p - a)a- a (p - a)^ 1 ) = Tr pa'* pa*' 1 - 1 

where a G [0,1]. If p and a commute, then this formula is independent of a. In the 
general case the above Sf(p, a) comes for a = 0. 

More generally, they defined 

xl(p,v) ■= (p-<7,n*(p-<r)), 

where VL k a = R~ x k{/S.{a / a)) and 1/k is a standard matrix monotone function. In the 
present notation = (J^^) -1 and for density matrices we have 

xiM = (pA) - i = (p, (j^rv) - 1 = 7 y fc (p,p) - 1. 

Up to the additive constant this is a monotone metric. The monotonicity of the \ 2 - 
divergence follows from ffT2l and monotonicity is stated as Theorem 4 in the paper [28], 
where the important function k is 

k a (x)= l -{x- a + x a - 1 ) and xl a =xl 
9 



l/k a is a standard matrix monotone function for a G [0, 1] and k a (x) is convex in the 
variable a. The latter implies that Xa is convex in a. The x 2 -divergence Xa is minimal 
if a = 1/2. (It is interesting that this appeared in [2B] as Example 4.) 

When l/k(x) = (1 +x)/2 is the largest standard matrix monotone function, then the 
corresponding x 2 -divergence is the smallest and in the paper [28] the notation X 2 Bures(.Pi a ) 
is used. Actually, 

poo 

XmresiP, a ) = 2 / Trpexp(-tu)pexp(-tu)dt- 1, 
Jo 

see Example 1 in |26j . 

The monotonicity and the classical inequality ffTUl) imply 

(when the conditional expectation onto the commutative algebra generated by p — a is 
used) . 

3 Extension of monotone metric 

As an extension of the operator (1T51) , define jL D2 : M n — > M n as 

J f DuD2 = fil, Dl R D \)R D2 = f(A(D 1 /D 2 ))R D2 = h Dl m f R D2 , , 
where / : M + — > 1R + . In this terminology 

Sf( Pl \\p 2 ) = (A,P puP2 A). 

Theorem [2] says that for a matrix monotone function /, (A J/^ P2 A) is a jointly concave 
function of the variables p\ and p 2 - 

The monotone metrics contains (Jp P ) _1 , therefore we consider the inverse 

In this chapter (3 is completely positive trace preserving mapping between matrix spaces. 

Lemma 1 Assume that Di, D 2 , (3(Di), (3(D 2 ) are positive definite and f > 0. Then the 
conditions 

/3*(4(d i) ,/ 3 (d 2 ))" 1 /3 < ^Ld 2 Y 1 (2°) 

and 

^D 1 ,D 2 f^ — J/3(Di),/3(D 2 ) (21) 

are equivalent. 
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Proof: The following inequalities are equivalent forms of f l20|) : 

ii aU) ,/3(D 2 )) ^(^Di,D 2 ) II ll(J_Di,_D 2 ) ^ i^P(Di),/3(D 2 )) ^(^D 1; D 2 ) II — ^ 

iiai.Dj 172 ^^)^))- 172 !^! 

("^9(£>i),/3(D 2 )) ^ /^(Jdi,D 2 )^ (^(Di),^^)) ^ — ^ 

The last inequality is equivalent to (|2T|) . □ 
Example 3 Let /(x) = sx + 1. Then 

(A (JLdJ^) = ^ is^Wlh) + l)- l K£A) = (A, ((sA(D 1 /D 2 ) + l)^)- 1 A) 
= (A,(sL Dl +R Z?2 )- 1 A). 

This was studied in the paper [TJ], where the result 

P*(sh KDl) + K/3(d 2 )) _1 /3 < (sL Dl + R^)- 1 (22) 

was obtained. Another formulation is 

W^W^ < $k,nX l ( 23 ) 

which is equivalent to 

< % {DimD2) (24) 

due to the previous Lemma. 

For f (x) = sx + 1 this is rather obvious: 

(A,p$ f DuDa 0*A) = sTr Dxf3*(A)f3*(A*) + Tr Tr D 2 f3* (A*) f3* (A) 

and 

(A4(Di)Ad 2 ) A ) = sTrD 1 p*(AA*) + TrTrD 2 p*(A*A). 
The Schwarz inequality 

f3*(X)/3*(X*) < f3*(XX*) 
is needed and gives f[2"2"j) and (jUj). □ 

Theorem 5 Lei /3 : M„ — > M m fre a completely positive trace preserving mapping and 
f : [0, +oo) — > (0, +oo) be an operator monotone function. Assume that Di, D 2 , (3(Di), 
0(D 2 ) are positive definite. Then 

$ ^I3(D 1 ),I5{D 2 )) 1 P — (Jdi,£> 2 ) 1 - 
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Proof: Due to the Lemma it is enough to prove (j2Tj) for an operator monotone func- 
tion. Based on the Lowner theorem, we consider f(x) — x/(X + x) (A > 0). So 

f _ h Dl 

and we need ( 1211) . The equivalent form (1211) is 

^{AliXI + Lp^Rjl^^^iA)) < (A,(XI + h Dl R-l)h-\A) 

or 

ATr/3(A*)/3( J D 1 )" 1 /3(A) + Ti f3{A)(5(D 1 )- 1 f3(A*) < \Tr A* D^A + Tr AD^ 1 A*. 
This inequality is true due to the matrix inequality 

(3(X*)f3(Y)- l f3(X) < f3{X*Y- 1 X) (Y > 0), 

see [15]. □ 

The generalized monotone metric 

1 f DuD2 (A,B):=(A,(^ DuD2 )- 1 B) (25) 

is an extension of the monotone metric which is the case D = D\ = D 2 . We can call it 
also as monotone metric with two parameters. (The use of this quantity is not clear to 
me in the moment, although the case f(x) = 1 + sx appeared already in the paper [H].) 

Example 4 Let f(x) = (x + l)/2. Then 

J f DuD B = \{D l B + BD 2 ) 

and 

/•oo 

^ f Dl DX 1C = / exp(-tD 1 /2)Cexp(-tD 2 /2)dt. 
Jo 

If D 1} D 2 and C commute, then 



□ 



Example 5 Let f(x) = (x — l)/logx. Then similarly to we have 

/ a — f T~)t a n 1 -* . 



¥ Dl , D A= I D\AD 2 dt. 

When 



D\ = / J \Pi and D 2 = 2J A^Q 
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are the spectral decompositions, then 

llf h,D 2 A = Y, m f( Xi >t 1 j) p i A Qj, 



(26) 



where is the logarithmic mean. (The formula is general, it holds for all standard 
matrix monotone functions /.) To show that 



POO 

[ C= (D 1 + tI)- 1 C(D 2 + tI)- 1 dt. 
Jo 

is really the inverse, we compute 



(A + tI)- 1 C{D 2 + tl)- 1 dt = J2 



PiCQj, 



If Di, D 2 and C commute, then 



D 1 -D 2 



log Di - log D 2 
We can recognize that in the commuting case 



-C. 



if 



J DuD2 C = m f (D u D 2 )C, 



it/ 



□ 



where m/ is the mean generated by the function /, rrif(x, y) = xf(y/x). 
Corollary 1 For a matrix monotone function f the generalized monotone metric 

(a (j£ 1)D2 r^> 

is jointly convex function of the variables D\ and D 2 . 



The difference between two parameters and one parameter is not essential if the matrix 
size can be changed. Let 



D 



D 2 
Di 



and A 



B 
B 



(27) 



We show that 

(AJ f D A) = (BJ f DitD2 B) + (BJ 9 DuD ,B) 

where g{x) = xf(x~ l ). Since continuous functions can be approximated by polynomials, 
it is enough to check f(x) = x k trivially. The case of inverse functions is similar. 

Lemma 2 For standard operator monotone function f , we have 

(A, ^ D A) = 2(B, I^ D B) and (A, (J^M) = 2(B, (S^^B) 
for the matrices p?7[). 



It follows that the monotonicity, Theorem [SJ and the joint convexity, Corollary [Tj, are 
consequences of the one parameter case. 
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